Real Time Tracking and Visualisation of Musical Expression
نویسندگان
چکیده
Skilled musicians are able to shape a given piece of music (by continuously modulating aspects like tempo, loudness, etc.) to communicate high level information such as musical structure and emotion. This activity is commonly referred to as expressive music performance. The present paper presents another step towards the automatic high-level analysis of this elusive phenomenon with AI methods. A system is presented that is able to measure tempo and dynamics of a musical performance and to track their development over time. The system accepts raw audio input, tracks tempo and dynamics changes in real time, and displays the development of these expressive parameters in an intuitive and aesthetically appealing graphical format which provides insight into the expressive patterns applied by skilled artists. The paper describes the tempo tracking algorithm (based on a new clustering method) in detail, and then presents an application of the system to the analysis of performances by different pianists.
منابع مشابه
On the analysis of musical expression in audio signals
In western art music, composers communicate their work to performers via a standard notation which specificies the musical pitches and relative timings of notes. This notation may also include some higher level information such as variations in the dynamics, tempo and timing. Famous performers are characterised by their expressive interpretation, the ability to convey structural and emotive inf...
متن کاملLive Tracking of Musical Performances Using On-line Time Warping
Dynamic time warping finds the optimal alignment of two time series, but it is not suitable for on-line applications because it requires complete knowledge of both series before the alignment can be computed. Further, the quadratic time and space requirements are limiting factors even for off-line systems. We present a novel on-line time warping algorithm which has linear time and space costs, ...
متن کاملA Structural Analysis of Musical Gnostic Prose works with an Emphasis on their Lyrical Contents
Gnostic prose works cover a wide range of subjects, contents, styles, structures, languages, and manners of expression. They might, therefore, be all categorized under one single literary genre. Applying the general term "gnostic prose works" to these oeuvres hinders our understanding of their true nature. Despite that many gnostic prose works belong to Gnosticism, they have special characteris...
متن کاملThe Performance Worm: Real Time Visualisation of Expression based on Langner's Tempo-Loudness Animation
In an expressive performance, a skilled musician shapes the music by continuously modulating aspects like tempo and loudness to communicate high level information such as musical structure and emotion. Although automatic modelling of this phenomenon remains beyond the current state of the art, we present a system that is able to measure tempo and dynamics of a musical performance and to track t...
متن کاملAnalysis of Musical Content in Digital Audio
Automatic analysis of digital audio with musical content is a difficult — but important — task for various applications in computer music, audio compression, and music information retrieval. This chapter contains a brief review of audio analysis as it relates to music, followed by three case studies of recently developed systems which analyse specific aspects of music. The first system is BeatR...
متن کامل